In the Claims: 

A complete listing of the claims is set forth below. 

1 . (Currently Amended) A computer-implemented method of determining i 
through the use of a processor, the performance of an advertisement , the 
method comprising: 

collecting a plurality of input data points; 

collecting a plurality of outcome data points; and 

calculating one or more performance scores based upon the input 
data points and the output data points; 

wherein the input data points include one or more of data points 
about an advertisement description, data points about a creative 
description, and data points about a user description, and wherein the 
outcome data points include one or more of data points about user 
opinions and data points about user experience . 

2. (Canceled) 

3. (Original) The method of claim 1 , wherein the one or more performance 
scores are accessible to an Evaluator through a computer-based application. 

4. (Original) The method of claim 1 , wherein the data points are 
accessible to an Evaluator through a computer-based application. 

5. (Currently Amended) The method of claim-2-J., wherein the 
performance scores include a composite performance score which is calculated 
using one or more of: 

a performance score calculated using data points about user 
experience; 

a performance score calculated using data points about user 
opinions; 
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a performance score calculated using data points about 
advertisement relevance; 

a performance score calculated using data points about an 
advertiser brand; 

a performance score calculated using data points about a web-site 
brand; and 

a performance score calculated using data points about user 
interest . 

6. (Currently Amended) The method of claim-2_l, wherein the 
performance scores include a user e xperienc e performance score calculated 
using the data points about user experience . 

7. (Currently Amended) The method of claim-2_l, wherein the 
performance scores include a subj e ctive performance score calculated using the 
data points about user opinions . 

8. (Currently Amended) The method of claim-21, wherein the 
performance scores includes a n objective performance score calculated using 
data points about objective criteria . 

9. (Original) The method of claim 1 further comprising: 

displaying a survey concerning the advertisement to one or more 

users; 

collecting the results of the survey; and 
calculating at least one of the performance scores based on the 
survey results. 

10. (Original) The method of claim 9, wherein the survey is presented to 
the one or more users as a pop-up window. 

1 1 . (Original) The method of claim 9, wherein the survey is accessed by 
the user via a link associated with the advertisement. 
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12. (Original) The method of claim 9, wherein the survey solicits text 
comments. 

13. (Original) The method of claim 12, wherein the text comments are 
viewable by an Evaluator. 

14. (Currently Amended) The method of claim 9, wherein a-usef 
o xp o rionc e performance score calculated using the data points about user 
experience is calculated using the survey. 

15. (Currently Amended) The method of claim-9 12, further comprising: 

analyzing the text comments to identify key words; 
assigning numeric values to the identified key words; and 
calculating tho subj o ctive_ a performance score calculated using the 

data points about user opinions, said performance score based at least in 

part on the numeric values. 

16. (Currently Amended) The method of claim-9_12, wherein the text 
comments are viewable by an Evaluator. 

17. (Currently Amended) The method of claims J., wherein-user- 
d o scription the data points about a user description are determined from cookies. 

18. (Currently Amended) The method of claim-2-J., wherein the-a4 
doscr i ption data points about an advertisement description are downloadable 
from one or more external data collection databases. 

19. (Currently Amended) The method of claim-2_l, wherein the creat i v e 
d o script i on data points about a creative description are downloadable from one 
or more external data collection databases. 

20. (Currently Amended) A computer application stored on a computer- 
readable medium and executed by a processor, the computer application 
capable of devaluating an advertisement, the application comprising: 
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object i ve data collecting means for collecting a plurality o f object i v e 
data points about objective criteria regarding the advertisement; 

subjective data collecting means for collecting a plurality of 
subjective data points about user opinions regarding the advertisement; 

user oxporionc e data collecting means for collecting a plurality of 
user oxp o r io nco data points about user experience regarding the 
experience of one or more users that have viewed the advertisement; 

advert i sement d e script i on data collecting means for collecting a 
plurality of advertisement d e scription data points about an advertisement 
description regarding characteristics of the advertisement; 

creative d e scription data collecting means for collecting a plurality 
of cr e at i ve descr i pt i on data points about a creative description regarding 
the content of the advertisement; 

user descript i on data collecting means for collecting a plurality of 
user doscr i pt i on data points about a user description regarding 
characteristics of one of more users; and 

calculating means for calculating one or more performance scores 
from the plurality of data points. 

21 . (Original) The computer application of claim 20, further comprising a 
means to present one or more performance scores to an Evaluator. 

22. (Original) The computer application of claim 20, further comprising 
means to present the data points to an Evaluator. 

23. (Currently Amended) The computer application of claim 20, wherein 
one of the performance scores is a composite performance score which is 
calculated using one or more of: 

a performance score calculated using data points about user 
experience; 

a performance score calculated using data points about user 
opinions; 
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a performance score calculated using data points about 
advertisement relevance; 

a performance score calculated using data points about an 
advertiser brand; 

a performance score calculated using data points about a web-site 
brand; and 

a performance score calculated using data points about user 
interest . 

24. (Currently Amended) The computer application of claim 20, wherein 
one of the performance scores is a user oxporionce performance score 
calculated using the data points about user experience . 

25. (Currently Amended) The computer application of claim 20, wherein 
one of the performance scores is a subjectiv e performance score calculated 
using the data points about user opinions . 

26. (Currently Amended) The computer application of claim 20, wherein 
one of the performance scores is a n objective performance score calculated 
using the data points about objective criteria . 

27. (Original) The computer application of claim 20, further comprising 
means to download data from external collection databases. 

28. (Original) The computer application of claim 20, further comprising: 

means for displaying a survey concerning the advertisement to one 

or more users; 

means for collecting the results of the survey; and 

means for calculating one or more performance score based on the 

survey results. 

29. (Original) The computer application of claim 28, wherein the survey is 
displayed to the one or more users as a pop-up window. 
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30. (Original) The computer application of claim 28, wherein the survey is 
accessed by the user via a link associated with the advertisement. 



31 . (Original) The computer application of claim 28, wherein the survey 
solicits text comments. 

32. (Original) The computer application of claim 31 , wherein the text 
comments are viewable by an Evaluator. 

33. (Currently Amended) The computer application of claim 32 further 
comprising: 

analyzing means for analyzing the text comments to identify key 

words; 

assigning means for assigning numeric values to the ana l yzed 
identified key words: and 

calculating th e subj e ct i v e^ performance score calculated using the 
data points about user opinions, said performance score based at least in 
part on the numeric values. 

34. (Currently Amended) The computer application of claim 20, further 
comprising cookie inspection means for determining usor doscr i pt i on the data 
points about a user description from cookies. 

35. (Currently Amended) The computer application of claim 27, wherein 
the ad d e scr i pt i on data points about an advertisement description are 
downloaded from the one or more external data collection databases. 

36. (Currently Amended) The computer application of claim 27, wherein 
the cr e at i v e descr i pt i on data points about a creative description are downloaded 
from the one or more external data collection databases. 
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